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Abstract 

Queueing  systems  which  Include  the  possibility  for  a customer  to 
return  to  the  same  server  for  additional  service  are  called  queueing 
systems  with  feedback.  Such  systems  occur  In  computer  networks,  production 
networks,  street  traffic  networks,  neural  networks,  and  the  like.  In  spite 
of  these  potential  applications,  the  study  of  such  systems  within  the 
field  of  queueing  theory  is  almost  absent. 

In  this  paper  we  will  present  a few  results  for  a broad  class  of  queues 
with  instantaneous  feedback.  Of  particular  interest  here  are  queues  with 
Markov  renewal  arrival  processes,  service  times  dependent  on  customer  types 
and  feedback  mechanisms  depending  on  queue  length  increments,  service  times, 
customer  types  and  previous  histories  of  the  feedback  mechanism.  It  will 
be  shown  that  networks  as  simple  as  Jackson  networks  with  one  server  can 
present  some  formidable  and  unsolved  problems.  Special  attention  will  be 
placed  on  these  unsolved  problems  and  new  areas  of  queueing  theory  in  need 
of  research. 


1.  INTRODUCTION 


1.0.  Background . In  this  paper  we  are  concerned  with  queues  with  feedback. 

There  are  at  least  two  interpretations  that  one  can  give  to  such  a statement. 

We  are  concerned  with  a single  server  who  serves  an  arrival  stream.  Upon 
completion  of  service,  the  customer  may  return  for  additional  service  or  may 
depart  the  system,  never  to  return.  An  alternate  use  of  the  words  "queues 
with  feedback"  has  been  given  in  several  publications  by  Kopocinski  [1963), 
Koposinska  [19671,  and  Kopocinska  and  Kopocinski  [1972). 

Problems  of  the  type  we  describe  seem  to  have  first  been  studied,  for 
M/C/1  queues,  by  Takacs  [1963).  The  problem  became  of  interest  to  computer 
systems  analysts  under  the  name  of  round  robin  queueing  and  foreground- 
background  queueing.  Kleinrock  [1975;1976]  or  Wyszewianski  and  Disney  [1975) 
provide  a thorough  review  of  the  computer  modelling  area  including  the  feedback 
problem.  Our  interest  in  the  problem  originated  with  our  overall  interest  in 
flow  processes  in  queueing  networks.  Disney  [1975)  provides  an  overview  of 
the  queueing  network  problem  and  places  the  feedback  problem  in  that  context. 

1.1.  Outline.  In  this  paper  we  will  study  a single  server  queue  with  feedback. 
The  arrival  process  is  a Markov  renewal  process  on  a finite  state  space — 
called  an  MR^  process.  The  server  process  is  a renewal  process  for  each  arrival 
"type"  (b) . The  process  is  called  a C^  process.  Upon  completion  of  service, 
the  unit  feeds  back  or  doesn't  feed  back,  depending  on  previous  feedback 
decisions.  Increments  in  the  queue  length  process,  service  times  Just  consumed, 
and  customer  type.  Feedback  always  occurs  instantly. 


2 


i 

i 


In  section  2 we  present  the  problem  formally.  In  section  3 we  will 
present  results  for  the  general  problem  stated  above.  Of  particluar  concern 
here  is  the  queueing  output  process  (see  2.1(B)).  We  then  allow  MR^  to  be  a 
superposition  of  independent  Poisson  processes  and  explore  the  output  process 
in  detail.  The  busy  period  process  is  discussed  in  section  3.  The  queue 
length  process  is  obtained  marginally  from  the  output  process.  We  will  simply 


discuss  (without  proof)  that  process,  and  provide  some  references  on  it  in 
section  4.  Research  is  still  in  progress  on  the  departure  process  and  waiting 
time  process.  The  departure  process  is  discussed  in  section  4.  A brief 
discussion  of  the  waiting  time  process  is  also  considered  there. 


2.  PRELIMINARIES 


2.0.  Introduction.  We  will  be  primarily  concerned  with  queues  with  feedback 
in  which  the  arrival  process  is  a collection  of  mutually  independent  Poisson 
processes.  In  this  section  we  will  define  the  problem  in  somewhat  more 
generality  by  allowing  the  arrival  process  to  be  a finite  state  Markov 
renewal  process. 


2.1.  Formal  Structure.  Units  arrive  to  a single  server  queue  at  epochs 


T1  < T2  < 


< T < 

m 


If  Z denotes  the  type  of  the  m — arrival  and 
m 


X » t - t , represents  the  time  between  the  (m-1)—  and  the  m^  arrivals, 
m m m-i 

Then  the  sequence  Z ,X  will  be  called  the  arrival  process.  The  different 

m m 

types  of  arrivals  form  the  state  space  of  the  arrival  process. 
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Assumption  A.  The  arrival  process  (Z  ,X  } is  an  irreducible,  aperiodic 
Markov  renewal  process  over  the  state  space  (1,2, ••*,b).  Moreover,  the 
stationary  transition  probability  A^^(x)  * Pr( Z^ * k.X^^ x| Z^ * h) , is  such 

b 

for  all  x 0,  A^COf)  * 0,  and  J A^f®)  ” * for  ^ “ 1*2,  • • -b,  k*l,2,*'*,b. 

k-1 

b b b b 

Throughout  this  paper  sysbols  such  as  [ or  n is  used  to  denote  £ or  n . 

k c k“l  c-1 

Let  the  probability  distribution  of  the  interarrival  time  Xm  be 

b 

Bh(x)  - l Ahk(x)  for  h " 1 , 2, • • • ,b . 
k 

Furthermore,  let  a^k  » Ahk(®)  be  the  transition  probabilities  of  the  underlying 

Markov  chain  (Z  }. 

m 

We  will  call  this  arrival  process  an  MR^  process  to  denote  that  it  is  a 
Markov  renewal  process  with  b («”)  states.  In  most  of  our  work,  we  will  be 
concerned  with  the  special  case  in  which  the  arrival  process  is  the  super- 
position of  b mutually  independent  Poisson  processes  with  parameters 
X^(k « 1,2, • • • ,b) . In  this  cases,  we  will  call  the  arrival  process  an 
process . 

Let  S be  the  length  of  the  tr^  service  and  Z1  be  the  type  of  the  unit 
n n 

which  received  the  n~ 1 service.  The  sequence  (S  Z’}  will  be  called  the 

n n 

service  process . Notice  that  Z^  j*  Z^  in  general.  Z^  is  the  type  of  the  n^ 
arrival.  Z^  is  the  type  of  customer  receiving  the  n^1  service. 

Assumption  B.  The  service  process  (S^jzM  is  a sequence  of  mutually  condition- 
ally independent  random  variables  over  the  state  space  (l,2,*'*,bl.  That  is, 

Pr[S  <s  ,S  < s , ‘ • ,S  < s |Z’  ,Z’  •••.Z’  ] 

1 nj  — nj  n2  — n2  nk  — nk  nl  n2  nk 


» Pr[S  < s I Z ' 1 Pr ( S < s |Z*  ] •••  Pr|S  < s |z’  ). 
1 ni  — r»i 1 r»i  n?  — n?1  n2  nk  — nk  nk 


2 — n2  n2 


nk  ~ nk  nk 
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t 


t 


for  all  nj  In  0,1,2,  •••  and  all  s^  e 1R+  and  n^  i n j . Moreover, 

Hr(x)  - Pr{Sn  < x | - r}.  Is  such  that  Hr(Of)  - 0,  Hr(«)  - 1,  Sr  - E I | - r]  < » 
and  Vr  ■ VISR|Z-  -r]  « « for  r - 1 , 2 , • • * , b . 

We  denote  the  service  process  by  G^.  When  b **  1 , the  service  process 

becomes  renewal  (G)  and  the  probability  distribution  is  then  noted  by  H(’)- 

Let  service  completions  occur  at  epochs  0 - t„  < t.  < t~  < • • • < t < •••  . 

0 1/  n 

{t  } is  the  sequence  of  output  epochs.  Let  N - N ( t +)  be  the  vector  of 
n r — n — n 

queue  lengths  at  t^ + . The  entry  denotes  the  number  of  type-c  units  in 

the  system,  excluding  the  fed  back  unit  it  feeds  back. 

Associated  with  the  ir~'  output,  the  random  variable  Y is  defined  as 

n 

follows : 


Y 

n 


0 , if  the  n—  output  departs. 


v , if  the  n — output  feeds  back  into  a type-v  customer 
(v  - 1 ,2, • • • ,b) . 


The  value  that  Y takes  is  referred  to  as  the  output  status  of  the  n— 

output.  The  state  of  the  system  at  t + is  Y *u  and  N * i = [i  1,  with 
r n n — n — c 

the  understanding  that  the  queue  length  of  type-c  units  is  6 + i^.  The 

sequence  {Y^}  is  called  the  switching  process  and  is  determined  by  the 
following 


Assumption  C.  The  output  status  depends  only  on  the  previous  output  status, 
ie  increments  in  the  queue  lengths,  the  amount  of  service  the  unit  has  just 
received  and  the  type  of  unit  receiving  the  service.  That  Is, 


L_ 


Pr  ( Y «v|Y  . ■ u , N - |,N  -i,S  * y , 7. ' ■ r ) 
it  1 n- 1 it  n- 1 it  7 it 


pOv(j.r;y),  if  u « 0 & i - 0, 


p (o, r;v),  otherwise; 

1 IIV 


where  e - (J  +6  -6  -1]. 

— Jc  re  ue  c 

We  assume  that  every  customer  eventually  leaves  the  system.  Thus 
we  have  an  open  network  in  the  usual  sense.  If  iverv  customer  departs 
the  system  after  one  service  time  then  the  following  results  are  relevant 
to  MR^/C^/1  queues  without  feedback.  In  that  case  the  departure  process 
and  the  output  process  are  identical.  Thus  results  pertaining  to  outputs 
are  in  reality  results  for  the  departure  process. 

Concerning  the  time  between  service  completions  and  the  re-entry  of 
a fed  back  unit,  we  have 


Assumption  D.  There  is  no  delay  in  feeding  back  a unit. 

After  a service  completion,  the  next  unit  to  be  served  is  chosen 
according  to  the  following  service  discipline. 


Assumption  E.  Whenever  there  is  no  unit  in  the  system  just  after  the  (n-1)— 

output,  the  server  remains  idle  until  the  first  arrival.  This  arrival 

determines  the  type  of  unit  receiving  the  tr— - service,  Z'.  In  the  case 

n 

where  the  system  does  not  become  empty  after  t ,,  the  next  unit  to  be 

n-1 

served  is  chosen  from  the  non-empty  queue  having  the  lowest  type  index. 

That  is,  Z^  « r where  r*min{c:Suc  + i^  > 0,  c ■ 1,2,  • • • ,b ).  Among  units  of 
the  same  type,  the  service  discipline  is  first-come,  first  served. 
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The  additional  three  assumptions  are  also  made. 

Assumption  F.  At  epoch  t^,  a service  completion  occurred  and  the 
corresponding  unit  left  the  system.  Moreover,  the  initial  queue  length 
probabilities  are  given  to  be  Pr{N^  • _i  | Yq  ■ 0}  - q^(i_)  . 

Assumption  C.  There  exists  an  infinite  capacity  for  each  type  of  unit  in 
front  of  the  server. 

As sump t ion  H.  There  is  only  one  server. 

The  queueing  system  with  feedback  to  be  referred  to  in  sections 
2-4  is  the  model  which  satisfies  the  above  assumptions.  Therefore,  we 
give 

Dmflnltion  2.1.  An  MR^/G^/l  queue  with  feedback  is  a queueing  system 
satisfying  assumptions  A through  H. 


1.  QUEUEING  PROPERTIES 

3.0.  Introduction.  In  section  2 we  established  t he  general  framework  of  the 
model.  In  this  section  we  will  explore  some  of  its  properties. 

Though  the  assumptions  of  the  model  in  section  2 are  more  general  than 
we  will  pursue  in  detail,  one  can  obtain  some  results  from  them.  These 
results  will  occupy  our  attention  in  section  3.1.  In  the  remainder  of  the 
sect  ion,  we  will  turn  to  the  special  case  of  superposed  Poisson  processes  and 
study  the  output  process  and  busy  period  process  in  detail.  The  queue  length 
process  will  be  only  mentioned.  The  departure  process  can  be  obtained  from 

results  herein  by  filtering  the  output  process  on  Y ■ 0.  Some  details  for 

cases  in  which  { Y > does  not  depend  on  are  given  in  d'Avignon  and  Disney  [1978]. 
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The  sojourn  times  problem  can  be  given  a Markov  renewal  structure,  but  it 

seems  to  be  quite  difficult  to  work  with.  The  only  complete  results  we  know 

of  for  this  process  are  those  given  in  Takacs  [1963]  for  the  M/G/l  queue 

with  {Y  } a Bernoulli  process, 
n 


3.1.  The  Output  Process . The  queueing  system  is  considered  at  output  epochs 

t . Denote  by  K the  type  of  the  last  arrival  before  t and  by  U the  time 
n 1 n v n 7 n 

since  the  last  arrival  measured  from  t . Moreover,  let  0=t-t  .,0=0 

n n n n-1  o 

be  the  output  interval  between  output  epochs  t ^ and  t^.  The  sequence 
{Yn,N^,Kn,Un> 0^}  is  called  the  output  process.  The  state  space  of  such 
random  process  is  the  cross  product  of  a denumerable  set  and  the  non-negative 
real  numbers. 

Denote  by  I the  idle  period  preceeding  the  rr^1  output.  Notice  that 

whenever  the  system  does  not  become  empty  after  the  service  completion  t 

1=0. 

n 

Later  on,  we  will  need  to  establish  relationships  among  the  random 

variables  N ,K  ,U  ,S  and  I for  different  output  epochs  t 's.  Figures  3.1 
-n  n n n n n n 

and  3.2  below  illustrate  some  of  the  relationships. 


Z' 

n 


N i 
— n-1 


-n 


Figure  3.1.  The  process  with  an  idle  period. 
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Figure  3.2.  The  process  without  an  idle  period. 


Proposition  3.1. 

Z\  Y .,  N ., 
n n-1  — n-1 


Proof.  If  Y 


n-1 


is  given  by 


The  random  variables  N , K and  U depend  only  on  S , 

— n n n n 

K , , and  U , . 
n-1  n-1 

» u,  the  total  number  of  units  in  the  system  just  after  tn_^ 


b 

l <« 

c 


uc 


Nn-1> 


Therefore,  the  system  is  idle  or  not  depending  on  this  last  quantity; 
consequently,  one  considers  two  cases. 


i)  B - 0:  assumption  A and  Figure  3.1  make  apparent  that  N^,  and 

U depend  only  on  S and  Z'. 
n 1 n n 

ii)  B > 0:  in  this  case  the  service  starts  immediately  on  a new  unit. 
According  to  assumption  E,  this  new  unit  is  of  type  Z^  ■*  r where 


r ■ tnin{c:  6 + NC  . > 0,  c * l,2,***,b}. 

uc  n-1 


Again,  using  assumption  A and  from  Figure  3.2,  it  is  clear  that  N^,  Kn  and 

U depend  only  on  S , Y ,,  N , , K ,,  and  U .•  O 
n v 7 n’  n-1*  -n-1’  n-1  n-1 


Denote  by  f^(o,y,t|s)  the  Joint  probability  of  and  U^.  In  words, 

this  is  the  probability  for  a set  e ■ [e^J  of  arrivals  in  an  interval  of 
length  y-t  with  the  last  one  of  type  k and  no  other  arrival  during  a length 
t given  that  prior  to  that  interval  of  length  y-t  the  last  arrival  was  of 
type  h and  occurred  at  a distance  s from  the  beginning  of  the  interval  of 
length  y-t.  Let 


1 " el  + e2  + 


b’ 


be  the  total  number  of  arrivals  in  the  length  y-t.  Then, 


fhk^y‘t|s)  “ Pr(Z—  “ k*  X"^>  + + ‘ V_t  + 8 


m+1 


'nt+1 


m+i 


with  ec  type-c  arrivals,  > 1 1 Zm  - h.  ^ > s>. 


For  the  case  where  e - 0,  the  above  probability  is  found  to  be 


1-Bh(t) 

fhll(Q.y.t|s)  - Shkfi(s  + y-t)  j :-B--(aj  • 


since  there  is  no  arrival  in  the  length  y-t,  one  must  have  t - s + y and  the 
last  arrival  of  type  h. 

For  the  case  where  e + 0,  there  is  some  arrival  and  t must  be  smaller 
than  or  equal  to  y.  Otherwise,  f k(e,v,t|s)  - 0. 


Proposition  1.2.  Whenever  l i 0.  it  depends  only  on  7.'.  K . and  II 
c n r i n n-1  n-1 

and  its  probability  distribution  is  given  by 


Pr  U < x|z'  - r,  K . - h,  U . - s)  - 

n - n n-1  n-1 

for  r,h  ■ l,2,***,b  and  x,s  > 0. 


VS+X)'Ahr(8) 

ahr'Ahr(8) 


to 


\ 


[ 


Proof . From  assumption  A,  one  has  that  1^  depends  only  on  Z^,  K^_ ^ and  l'n_j 
Furthermore,  It  follows  that 


(1) 


Pr{  Z ' • r , II  . -s,  1 < x|K  , - hi 

Pr  {I  < x|z'«r,  K ,-h,  U , - si  - — r= — =t n 

n — ' n n-1  n-1  {Pr  Z - r,  U , 

n n-1 


s|  K , - hi 
n-1 


By  considering  the  arrival  process  defined  in  assumption  A,  one  finds 


Pr{Zn"r*  Un-1  " s 1n-xlKn-l  ' h)  " Ahr("+x)  " V(s)  * 


and 


pru;-r-  Vi^iVi"1'1  ■ v - At,r(N) 


which  after  substitution  in  (1),  gives  the  desired  result.  O 


t)> 


Proposition  3^_3 . The  type  of  the  n—  output,  Z'  , depends  only  on  Y^_ ^ 


N , , K . and  U and  its  probability  distribution  is  given  bv 
—n-1  n-1  n-1 


Pr{Z*  - k|Y  ,-u,  N . - l,  K , - h,  U , - si  - 
n 1 n-1  -n-1  — n-1  n-1 


rthk  ~ \k  ^ 

T-B,  (s)  ' • lf  U"°  & i " £• 


A , otherwise; 
rk 


where  r 


- mln{c:  A +i  >0,  c - 1 ,2,  • • • , b 1 . 
uc  c 


Proof.  Again,  there  are  two  cases  to  consider: 


i)  u - 0 and  1 - 0:  in  this  case  the  system  becomes  idle  Just  after  the 


output  epoch  t j.  From  assumption  A,  the  next  arrival  which  becomes 
th 


the  n — output  depends  only  on  and  II  Furthermore,  its 

probability  distribution  is 


..  id 
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(1) 


PtU'n-kIVl  ■ "•  Vi’*1 


l'rlZ;-k-  Vl 


By  the  arrival  process  of  assumption  A,  one  has 


(2) 


Pr{Zn“k’  Vl“8lRn-l‘h}  " ahk'Ahk(s)  • 


and 


(3) 


Pr(Vi-*lVi-hl ' i -“„<»>■ 


Substituting  equations  (2)  and  (3)  into  equation  (1),  one  obtains  the 
first  part  of  the  desired  result. 

ii)  u j*  0 or  JL  i 0:  in  this  case  the  system  remains  busy  after  t ^ 

and  the  next  unit  to  be  served  is  chosen  with  respect  to  assumption  E. 
Therefore,  the  type  of  the  output  Is  7/  ■ r,  where 

r ■ min{c:  6 +i  >0,  c • l,2,,-,,b). 
uc  c * 

Then,  the  second  part  of  the  theorem  follows.  Q 

Now,  one  has  the  following  important  result. 

Theorem  3.4.  The  output  process  {Y  ,N  ,K  ,11  ,0  ) is  Markov  renewal  over  the 
r r n -n  n n n 

state  space 

{0,1,  • • ■ ,b}  X{0,1,2,- ••}b  X{  1,2,  * • * ,b)  X|0,«'). 

Proof.  By  definition,  the  range  of  the  random  variable  Y is  t0,l,**-,b) 
and  by  considering  the  range  of  the  other  random  variables,  one  obtains  t lie 


state  space  specified. 


r 


rm — 
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The  output  Interval  0^  can  be  written  as 


0 - 

n 


I 

n 


+ V 


b 

if  l (6  + N°  .)  - 0, 

£ uc  n-1 

otherwise; 


where  u is  the  value  taken  by  the  random  variable  Y . . 

n-X 

The  above  relationship  gives  two  cases: 
b 

i)  y (6  + Nl  . ) - 0:  this  case  corresponds  to  the  situation  where 

L uc  n-1 
c 

the  (n-1) — output  departs  from  the  system  leaving  the  server  idle. 

Therefore,  a unit  of  unknown  type  must  arrive  to  initiate  the  service 

period  S . Let  7 be  the  type  of  this  new  arriving  unit.  This  unit 
n m 

will  also  be  the  n^-  output;  therefore  7 ^ - Z^.  and  one  has  the 
fol lowing: 


(1)  Pr{Y  N ,K  ,U  ,0  < x|Y  •••,  ;N  ,,•••;<)  •••} 

n — n n n n—  ' n-X  n- 1 n-i  n-1  n-l 


ex  b 

I 

J0  k 


Pr{ y |y  N i •••;  K . •••;  u , •••;  0 

n n-1  n n n-1 


I + S < x,  S - y,  Z'  - k) 
n n — n n 


Pr{ N ,K  ,U  I Y .,•••;  N 
— n n’  n1  n-1  -n-1’ 


► 


• If  • • • • I?  •••*()  •••• 

’n-1’  ’n-1*  ' n-1' 


1 + S < x,  S ■ y,  Z'  * k) 
n n n 1 n 


i 


p 

ii)  y'jfi  + NL  ,)  > 0:  in  this  case,  there  is  no  idle  period  and  the 
*£•  uc  n-  i 

service  immediately  starts  on  a new  unit  of  type  ■ r where 


r » minlc:  <S  + N . > 0,  c ■ 1,2, • • • ,bl . 
uc  n-1 


Thus, 


(4)  WTn,Wl,0,i>IVl."';Vl'-";Vr"'; 


-vy'  z;-r) 


Pr<W"nlVl'-;Vl>-iVl>-i0n-l’"'iSn‘T>  Zn  ' r) 


• Z^-rldy. 

using  the  fact  that  0 -S  in  this  case.  In  the  above  equation,  the  first 
° n n 

probability  term  on  the  right  hand  side  is  simply 

Pr{ Y I Y . ,N  . ,N  , S - y,  Z'  *=  r}  , 

1 n1  n-1  —n-1  —n  n 1 n 

using  assumption  C.  The  second  term  is  simplified  upon  using  proposition  3.1 

and  for  the  third  term,  one  notes  that  S depends  only  on  Z'  ■ r from  assumption  B. 

n n 

Hence,  equation  (4)  becomes 

(S)  PrfVWn.On  i *1  Vl- -‘Vl'"'1  Vl'' ' ' ; Vl''  "'Vl''"1 


Pr{Y  |Y  . ,N  ,,N  , S -y,  Z'  - r) 
n1  n-1— n-1— n n n 


• Prl!n'S»'"JVrS,-l'Vl'Vl'  Sn  " K‘r) 


• Pr{Sn-y|Z^-r)  dy  . 
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Equation  (5)  can  be  rewritten  as  equation  (3)  above  and  one  concludes 

that  {Y  ,N  ,K  ,Y  ,0  } has  the  Markov  renewal  property.  □ 
n — n n n n 

Corollary  3.5.  The  stationary  transition  probabilities  for  the  Markov  renewal 

process  {Y  ,N  ,K  ,11,0}  are  given  by 
n ~n  n n n 

Auv[(i,h,s),(J[,k,t);  x] 

- Kn-k,  Un-t,On<x|Vn.1-u,(ln.l.i,Kn.1-h, 


where 


AuvKl,h,s)  ,Q,k,t)  ;x] 


n 


p0vU.a;y>  fnV(i.y,  Ho) 


ak' 


Aha(s+x-y)-Aha(s) 


1 " Bh(s) 


dHa(y),  if  u = 0 & 1 = 0, 


/ 0 , if  ec  < 0 for  some  c, 


f 


Puv(e.r;y)  fhk(e,y, t|s)  dHr(y) , otherwise; 


with  e » tec ] and  ec  = Jc  + «rc  “ «uc  “ V for  r =mln<c:  6UC  + ic  > 0, 
c - 1,2, • • • ,b} . 


Proof . From  theorem  3.4,  there  are  two  cases  to  consider; 

1)  u = 0 and  1*0;  here  equation  (2)  of  theorem  3.4  can  be  applied  and 
after  using  assumption  C,  one  finds 


Pr{Yn-VIVl-0^l-H‘i*Sn-^Z;-1  “ Pov(^a;y) 


Pr{Nn-i.Kn-k.l)n-t|Sn-y.Zi;-a}  - fakU.y.t|0) 


Furthermore,  from  proposition  3.2, 


Aha(^x-y)-Aha(s) 


Pr{In  < x-ylZ^-a.Vj-h.UH.j--}  - “.^--^-7 8y 


and  from  assumption  B 


PrlS  - y | Z ’ - a}  dy  - dH  (y) 
n 1 n a * 


Finally,  from  proposition  3.3, 


a.  - A.  (s) 

Pr(Zn"alKn-l’h*  Vl‘8)  " ~1  - B(s) 

n 


rx  b 

A0vfO,k,s),Q,h,t);xJ  - £ P0v(J.,a  ;y>  fahU*V  I °> 

' u 


Aha(s>x-y)-Aha(s) 

l - Bh(s) 


dHa(y) 


11)  u > 0 or  1 i 0:  here  one  computes 


r ■ min{c:  6 +1  >0,  c » 1,2, •••,!>}, 

uc  c 


for  the  type  of  unit  to  be  served  and  one  can  apply  equation  (5)  of 


theorem  3.4  to  get 


1 
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(1) 


AuvU,h,s) , (J.,k,t)  ;x] 


*x 

Puv (e,r;y)  fhk(e,y,t|s)  dHr(y), 

0 


where  e «*  [e  ] with  e =1+6  -6  -i.  If  some  components 

— c c c uc  uc  c 

I + (5  -6  -i  are  negative,  the  transition  probabilities  given  by 

Jc  rc  uc  c 

equation  (1)  are  zero.  D 

Proposition  3.6.  The  joint  probability  distribution  of  and  0^  depends  only 

on  Y , , N ,,  K , , U .,  and  is  given  bv 
n-1  -n-1  n-1  n-1 

prlz’„  ■ k.  0n  < xlv^,  - u,  N,.,  - i.  Kn_,  -h.  ltn  l - .,) 

dH^Cy)  if  u * 0 and  i = 0, 

I 5rkHk^s^  u > 0 or  A ^ 0; 

where  r - min{c:  6 + i > 0,  c ■ 1,2, • • • ,b} . 

Proof . Using  theorem  3.4  and  proposition  3.3,  one  can  establish  the  correct 
dependence.  The  explicit  probability  is  found  by  using  corollary  3.5;  note 
that  In  the  case  u ■ 0 and  i*0,  a unit  of  type-k  must  arrive.  o 


F 

X 

Ahk(s+x-y)  " Ahk(s) 

0 

1 ~ Bh(s) 

> t 

3.2.  The  Case  MR^  ■ M^.  The  previous  general  results  can  be  expanded  on  or 
particularized  in  several  directions.  For  example,  by  allowing  b«l,  one  obtains 
results  for  Gl/G/l  queues  with  feedback.  If  further  there  is  no  feedback, 
one  obtains  a characterization  of  the  Gl/G/l  departure  process  previously 


V 
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obtained  by  Vlach  and  Disney  [1969].  Rather  than  pursue  those  directions,  we 
now  particularize  by  allowing  MR^  = M^.  We  start  with  a rather  obvious  lemma. 

Lemma  3.7.  MR^  = if  and  only  if  the  arrival  process  stated  in  assumption 
A has  the  stationary  transition  probability  distributions  given  by 

Ahk<x)  - ak(l-e-X^), 

where  for  “ 1.2, •••,b  and  x 1.  0.  represents  the  summation 

of  for  k going  from  1 to  b. 

Proof . The  necessary  part  is  easily  obtained  by  considering  results  from 
McFadden  [1962],  The  sufficiency  is  first  proved  for  b = 2j 
let  T^  be  the  time  interval  between  two  arrivals  of  type-k  units  for  k=l,2. 
If  N denotes  the  number  of  arrivals  necessary  to  obtain  a second  type-k  unit, 
then  N is  a random  variable  with  the  range  {l^,--"}  . 

Now,  the  probability  distribution  of  T^  is  derived  as  follows: 


(1) 


QD 

Ft  (x)  = £ Pr{T1  <_  x,N  = n} 
1 n=l 


£ F (x;n) . 

n=l  1 


Assumption  A is  used  to  find 


(2) 


Ft  (s;n) 
T1 


* 

lll' 


A,, (s)  , 


if  n = 1, 


A12(s)  [A22(s)  ]°  2A21(s)  , if  n = 2,3,' 


where 


1 


I 
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(3) 


Ahk(s) 


\ + v: + s 


for  h,k  • 1,2. 

Thus,  using  equations  (2)  and  (1)  into  equation  (1),  one  obtains 
* 'l 

VS)  ■ X~+« 

that  is,  is  exponentially  distributed  with  parameter  X^.  Similarly, 
one  can  show  that  T,,  is  also  exponentially  distributed  with  parameter  X. 

Since  the  stationary  transition  probability  distribution,  A^k(0  does 
not  depend  on  h,  the  types  of  two  consecutive  arrivals  are  independent. 

Also,  since  T^fk  ■ 1,2)  has  the  usual  forgetfulness  property,  the  arrival 
process  is  M0. 

For  the  case  b > 2,  one  can  form  two  groups:  X.  and  \\  » X,,  + X,,  + • • • + X 
and  use  the  method  above  to  show  that  T.  (k * 1,2, * * *b)  has  the  usual  forget- 
fulness property.  Therefore,  the  arrival  process  is  M^.  a 


Proposition  3.8.  If  MR^  = , then 


fhk(?*y.t,8) 


dhk'SCy+s-i)  exp(-(t-s)J[X)  , if  e - 0, 


expf  .X  (y-t))  [X  (y-t)  ] 

Xkexp(-tVX)Tlr ^ (er:gr 


if  e « 0; 


e - <S  , 

r rk 


for  e » [e  | and  e •0,1,2,* 

c c 
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Proof . There  are  two  cases  to  consider:  for  e * 0,  one  uses  lemma  3.7 


and  obtains 


fhkCS’y.tls)  ' <$h,6(t-s-y)  exp(-(t-s) Jx)  . 


For  e / 0,  one  needs  a set  e = [e  ] of  arrivals,  where  e denotes  the  number 

~ c c 

of  type-c  arrivals.  The  number  of  arrivals  of  each  type  in  an  interval  of 
length  y-t  is  Poisson  distributed,  and  since  one  wants  a type-k  arriving 
at  the  end  of  the  interval  of  length  y-t  and  no  arrival  for  a length  t. 


we  have 


e,  e.  -1 

k , . , k 


thk<s.y,t|»>  ■ TT 

171 


which  is  the  desired  result.  O 


b exp(-\ry)[>r(y-t) ] r A k (y-t) 


1~nr— exP(Ak(y-t)), 


Proposition  3.  9.  If  MR^  = M^,  then  the  output  process,  {Y^.N^.O^}  is  a Markov 
renewal  process  and  its  stationary  transition  probabilities  are  given  by 

A (i,j;x)  = Pr{  Y =v,N  = j,0  <x|Y  = u,  N =i}, 
uv  — n — n — n—  1 n-1  — n-1  — 


where 


*X  D T'r 

l vov(i*h;y)(i-exp(-<x-y>I*»  * » 

' Y*  r> 


^.exp(-Xcy) (Xcy)  C 


• dH^(y)  , if  u = 0 and  i_  = 0, 


Auv(i.l;x) 


if  e <0  for  some  c, 
c 


-rr  exp(-X  y)(X  y) 

Puv(e,r ;y) II  — j dHr(y),  otherwise, 

c * 
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with  e = [e  ],  e = j +6  -6  -i  ; for  r = min{c:  6 +i  > 0,  c = l,2,,-*,b} 

Proof.  Since  one  has  the  forgetfulness  property  whenever  the  arrival  process 

is  composed  of  independent  Poisson  streams,  the  information  on  the  arrival 

process  carried  by  K and  (J  becomes  unnecessary  and  can  be  removed.  Hence, 
r n n 

in  this  case,  the  output  process  {Y  ,N  ,K  ,U  ,0  } can  be  reduced  to  {Y  ,N  ,0  }. 

n — n n n n n -~n  n 

This  reduction  is  accomplished  by  computing  the  transition  probabilities 

b r°o 

(1)  A [<i,h,s)(j,*,*);x)  = l Auv!(i,h,s),(i,k,t);K]dt. 

k 0 

Consider  two  cases: 


i)  u = 0 and  jL  = 0_:  from  corollary  3.5,  equation  (1)  becomes 

fX  b b f" 

A^fCO.h.sMi, = | l l I pn„(i.a;y)  faV(j.,y,  t|0)  dt 


o k a 0 


0v' 


Aha(s+x-y)  -Aha(s) 


1"Bh(s) 


dHa(y)  . 


Thus,  one  obtains 

Aha(8+*-y)-Aha(8) 

= a [1  - exp(-  (x-y)£x)  ] . 

a 

Also,  from  proposition  3.10, 

one  finds 

. 6(y~t)  exp(-tEX), 

1 = 0, 

(2)  I fak(i.y.Ho) 

k 

= 1 b XJc 

f Rexp(-yLX)  TT  -pi  (y-t)R-1, 

\ c Jc- 

i * 0; 

i 

I 
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where  R = £ j . 
c 


Then 


x b 


l aaPQv(0,a,y)  (1  - exp(-(x-y)^A))exp(-  (y )£x)  dH^Cy)  , 


and  for  J.  ^ 0, 


A0v[0,h,s),(i,-,-);x] 


x b 


l otaP0v(l>a>y')  (1  ~ exp(-(x-y)£ X))TT 


exp(-(Acy) (Acy) 

v 


dHa(y) 


Since  the  right  hand  side  does  not  depend  on  h and  s,  one  can  write 


(3) 


A0v(0,i;x) 


x b 


b TT  exP("<Acy)(Xcy) 

[ aap0v(i,a;y) (1  “ exp(~(x-y)IA))l  I 7~ i dHa(y) 

a c c' 


ii)  u > 0 or  i i1  0;  again  from  corollary  3.5,  equation  (1)  becomes 

rX  b 


Auv[i,h,s),(J.,*,*);x]  = 


J k > 
0 K 


l puv(e,r;y)  fhk(e,y ,t| s)  dt  dHf(y) , 


where  r = min{c:  6UC  + *c  > 0,  c = 1,2, • • • ,b} ; using  equation  (2) 


and  integrating  out  t,  one  obtains 


Auv((jl,h,s),(Jv.’);x]  » Puv(e,r;y)TT 


— T gxp(-(  X^y)  (A  ^y) 


since 


ry  -i— r 

I fhk(e.y,t|s)dt  -I  I 

* H p 


•xp(-(X  y)(*  y) 


for  e - [e  ] with  e -1+6  -6  -i  >0.  Since  the  right  hand  side 

— 1 c c c rc  uc  c 

of  equation  (A)  does  not  depend  on  h and  s,  one  can  rewrite  it  as 


A (i,j;x)  - p (e 
uV  — -*•  uv  - 


,r  ;y)TT 


*1,.  exp(-(X  y)(\  y) 


c_ c_ 

p ! 


dll  (y). 
r 


Equations  (3)  and  (5)  prove  the  proposition.  □ 


Proposition  3.10.  If  MR^  - M^,  then  the  joint  probability  distribution  of 


Z'  and  0 is  given  by 
n n 


Pr{ Z ' - k,  0 < x|Y  - u,  N , - i) 
n n—  n — n-l 


fx 

(1  - exp(-(x-y)^A)dHj<(y)  , if  u*0  and  1*0, 


lSrkHk(x)  * 


if  u > Oor  1 0 


where  r - min{c:  5 + i > 0,  c ■ 1 , 2, • • • ,b) . 

uc  c 


Proof . Use  proposition  3.b  and  lemma  3.7.  O 
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Corollary  3.11.  If  MK,  ■ M.  , then  Z'  depends  only  on  Y . and  N . and  its 
j. — b b n n-1  -n-1 


probability  is  given  by 


Pr{  7, ' - k|  Y , - u,  N , - i 

n 1 n-1  n-1 


if  u - 0 and  1 ■ 0 


tS  . , 1 f n > 0 or  1 i 0 

rk 


where  r ■ min{c:  6 +i  > 0,  c . ■ 1,2,  • • • , b) . 
uc  c 


Proof.  Use  limit  as  x goes  to  >»  in  proposition  3. 10.  O 


Proposition  3.12.  If  MK^  - , then  Y^.7/, N^,0^  depend  on  Y^_ ^ and  Nn_j 

Moreover,  its  Joint  probability  distribution  is  given  by 


Pr{  Y -v,Z'-k,N  -j,0  *x|Y  . - u.N  ,-i) 
n n — n n 'n-1  -n-1 


fx  „ -A-  exp(-(X  y)(X  y) 

ak  j C1  “ exp(-(x-y)£A)P0v(j.,k;y)|  I d\(y>. 

0 c • e 


if  u * 0 and  1*0, 


ii 

5rk  f Puv^r-TT 


exp(- (X  y) (X  y)  1 


c c 
e ! 


, if  u > 0 or  i i1  0; 


where 


e - |e  1 with  e - I +6  -6  - i and  r « mln{c:  6 + i > 0, 

1 c c c rc  uc  c uc  c 


c - 1,2, • • • ,bl . 


Proof.  Using  propositions  3.0  and  3.10  it  follows  that  Y ,7,' ,N  and  0 
— * - - - nil  n n 

depend  only  on  Y j and  N^_j.  Depend  lug  on  whether  or  not  the  system  becomes 


idle  lust  after  t ,,  there  are  two  cases  to  consider: 
J n-1 


O' 


i)  u«0  and  i«0;  here,  one  notices  that  to  have  Z^*k,  the  first 

arrival  after  t ^ must  be  a type-k  unit.  Therefore,  following  the 
development  used  in  the  proof  of  proposition  3.9,  one  obtains  the 
first  part  of  the  desired  result. 

ii)  u > 0 or  JL  i*  0:  here,  the  type  of  the  next  unit  to  serve  is  given 

by  Z'  ■ r where 
1 n 

r ~ minlc:  S + i > 0,  c “ l,2,'--,b}, 

uc  c 

using  assumption  E.  Similarly,  one  obtains  the  second  part  of  the 
desired  result.  O 

3.3.  The  Busy  Cycle  and  Busy  Period.  In  this  section,  the  occupation  of 

the  server  is  analyzed.  This  occupation  alternates  between  busy  and  idle 

periods.  A busy  period  followed  by  an  idle  period  constitutes  a busy  cycle. 

If  I denotes  the  length  of  the  ir-h-  idle  period,  the  sequence  ti  l was 
m 

characterized  by  proposition  3.3. 

Lemma  3.13.  If  MR^  - M^,  then  the  idle  period  process  11^1  is  Poisson 
with  parameter  \\. 

Proof.  This  is  immediate.  O 

Now,  turning  our  attention  to  the  busy  period  process,  let  Bm  be  the 
length  of  the  nr~  busy  period  length  and  (!(•)  its  probability  distribution 
under  stationary  conditions. 


i 


26 


I 


Theorem  3.14.  If  MR^  » M^,  then,  under  stationary  conditions,  the  probability 
distribution  of  busy  period  lengths  is  given  by 


C*(s) 


b b 


-1 


l ar[L00(s;r)  + £ l L0u(s;r)  (I-J(s))^  Lv0(s;v)], 


where 


L (s;r) 
uv 


£/ 


o 


exp(-sy)p  (j  ,r;y) 
uv  k 


-pj-  exp(->  v)  (AkyC*(s)) 


j 


k‘ 


dHr(y); 


and  J(s)  is  the  matrix  |Luv(s;u)]  from  which  the  first  row  and  the  first 
column  have  been  removed. 


Comment . The  busy  period  is  independent  of  the  service  discipline  stated  in 
assumption  E.  Moreover,  the  order  of  service  is  immaterial  to  the  busy 
period  as  long  as  it  does  not  increase  the  time  spent  in  service.  Hence, 
one  can  give  priority  to  a fed  back  unit;  that  is,  a unit  is  given  successive 
periods  of  service  until  it  departs  from  the  system.  If  one  calls  the 
originator,  the  unit  which  initiates  the  busy  period,  the  busy  period  ot  the 
system  can  be  written  as  follows: 


(1) 


B » S + S + 
m n n+1 


+ S 


, _ + B + 

n+Fm  m 


+ B 


where 


S - the  (i+l) — service  period  of  the  originator, 
n+1 

F ■ number  of  feedbacks  of  the  originator, 
m 

b k 

K ■ 7 N * number  of  units  in  the  system  when  the  originator 
f*  n-FF 
k m 


departs. 
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N ^ * queue  length  of  type-k  units  Just  after  the  (1+1) — 
service  completion  of  the  originator. 

B^  - busy  period  initiated  by  the  1—  arrival  during  the  service 
m 

periods  of  the  originator. 

The  index  n refers  to  a count  on  the  number  of  services  by  the  server. 

The  service  period  S depends  only  on  the  type  7.',.  for  i»  1,2,  ••*,F 
r n+i  r n+i  m 

which  in  turn  depends  on  Y Hence,  given  the  output  type  Z j.  the 

service  periods  S ^'s  are  independent.  Furthermore,  during  the  total  period 

of  service  of  the  originator,  S +S.,+>-*+S1„,  there  have  been  K 

° n n+1  n+F 

m 

arrivals  divided  among  b different  types.  Since  the  arrival  process  is  M^, 

the  sequence  of  types  of  these  K arrivals  constitutes  an  independent  process. 

Moreover,  each  of  these  K arrivals  will  be  the  originator  of  the  busy  period 

B'^  for  some  1«1,2,*'*,K.  Therefore,  all  B^'s  are  independent  and  have  the 
m , m 

same  probability  distribution  that  has,  (!(•).  Moreover,  each  busy  period 
Bj^  is  independent  of  the  above  service  periods,  S j . 

Proof  (of  theorem  3.14).  If  Z denotes  the  type  of  the  originator,  then  the 
probability  distribution  of  the  busy  period  B is  derived  as  follows: 

C(x)  » Pr{ B < x} 
m — 

b 

- I a J.Pr{B  < x , F * k | Z ■ r } 
u r ‘'k  m m 1 m 

r 

b 

(1)  “ l ar  5!kGk(x;r)- 

r 


Using  equation  (1)  in  the  comments,  the  probability  term  for  k - 0 in 
equation  (2)  is 

(2)  G~(x; r)  - Pr{S  + Bl + • • • + BK  < x,Y  * 0 1 Y . « O.N  - 0,Z  - r) 

v/  0 n m m — n 1 n-1  -n-1  m 


- x b **  k 

V'  I (h)  *TT  exp(  "(xky)(xky) 

Zu  GU)(x-y)p  a,r;y)M  r*j dH  (y) ; 

i >0JQ  00  k V 


where  h ■ £ j,  . Considering  the  Laplace-Stielt jes  transform  of  the 
k 

probability  distribution  given  in  equation  (3),  one  gets 


G0(s;r)  * LQ0(s;r); 


using  an  appropriate  change  of  variables  and  the  notation 


f -T-T  exp(-(A  y)(A  yG  (s)) 

2^  I exp(-sy)  p (i,r;y)l  I r~, dHr(y), 

1>0  Jo  k Jk ’ 


Luv(s;r) 


for  every  u,v  * 0,1, •••,b. 

For  the  case  k«l,  the  term  on  the  right  hand  side  of  equation  (2)  is 


Gj(x;r)  - l 'rCSn  + S„tl  + Bi+.. Yn-.,Ylrt.I.0|tn.1.0, 


N . - 0,  Z - r} 
—n-1  — m 


■EE 


X f x— y b 


Lu  \ I G (x-y-z)Pv0(i-  i,v;y) 

12.0  1 >i  o o v 


Jy  exp(-(Aky)  (A^y) 
k ^k~  'k)! 


•*k  “ *k 


b * 

-r-r  exp(-(Aky)(Aky) 

• I I dH  (y), 


w 


I 
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where  h ■ J j,  . Now,  taking  the  Laplace-Stieltjes  transform  of  the  above 
k k 

distribution,  and  by  an  appropriate  change  of  variables,  one  finds 


(5)  Gj(s;r)  - j LQv(s; r)LvQ(s;v) ; 

v 

using  notation  given  in  equation  (A). 

Now,  for  k»2,  one  could  find 
* b b 

S(s;r)  “ l I Ln1,<s:r)J,,v(s)Lvn(s;v)' 


U V 


where  J(s)  is  the  matrix  [l.iv(s;u)l  from  which  the  first  row  and  the  first 
column  has  been  removed.  It  also  follows  that  for  k > 1 


(6) 


Vs;r>  = l l Ln,^s:r><jK~i(s)>,.„L„n(siv)- 


b b 


k-1 . 


J0u 


uv  vO 


For  a fixed  s with  Re{s)  _>  0,  the  matrix  J(s)  is  such  that 
b 


0 £ L (s;u)  < 1 and  £ L (s;u)  < 1,  using  the  definition  of  Luv(s;u) 

v 

and  condition  1 of  assumption  C.  Thus,  all  the  eigenvalues  of  J(s)  have 
moduli  less  than  1,  using  a result  from  Lancaster  [1969].  Therefore, 

£ jk(s)  converges  and  is  equal  to  (I-J(s))  Hence,  summing  equation  (6) 

k 

over  k from  1 to  <*>,  one  obtains 


b b 


l ck+l(s:r)  " It  L0u(s;r)([I-J(s)1uv  Lv0(s:v)  » 


U V 


together  with  equation  (3),  equation  (A)  gives  the  desired  result,  a 


Notice  that  when  the  arrival  process  MR^  is  considered,  the  busy  periods 

B^  and  B*1  for  i h are  no  longer  independent, 
mm 
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4.  QUEUE  LENGTHS,  DEPARTURE  PROCESSES,  WAITING  TIMES 

4.0.  Introduction.  The  purpose  of  this  section  is  to  expose  some  of  the 
literature  that  explores  various  special  cases  of  the  general  structure  of 
sections  2 and  3.  We  will  be  principally  concerned  with  those  results  for 
queue  length  processes,  departure  processes,  and  waiting  time  processes. 
Several  previously  obtained  results  occur  by  giving  particular  values  to 
the  parameters  of  the  general  model.  We  will  not  stop  to  point  these  out. 

They  are  noted  in  the  referenced  literature. 

4.1.  Queue  Lengths.  It  is  clear  that  sections  3.1,  3.2,  3.3  give  the  major 
tools  one  needs  to  work  with  the  queue  length  processes  of  these  systems. 

In  particular,  for  example,  proposition  3.9  gives  the  {Y^.N^.tM  structure 
in  some  detail.  Clearly,  [Y^.N^}  is  an  embedded  Markov  chain  for  the  M^/G^/l 
queue  with  the  feedback  structure  given  in  section  2.1.  Thus,  in  principle, 
the  embedded  queue  length  process  is  a Markov  process  whose  transition 
probabilities  are  now  known.  The  study  of  the  process  is  straightforward 
albeit  quite  cumbersome  to  execute. 

Furthermore,  again  taking  3.2  as  an  example,  {Y(t),N(t)l  — the  continuous 
time  queue  length  process  for  the  queue  with  feedback — is  a semi- 

regenerative  process  in  the  sense  of  Qinlar  [1975]  and  can  be  studied  ns  such 
using  the  results  of  section  3.2. 

d’Avignon  and  Disney  [1976]  study  the  embedded  queue  length  process  for 

the  M/G/l  queue  with  the  feedback  structure  given  in  section  2.1,  but  without 

7.'  dependence.  As  above,  {Y  ,N  ) is  a Markov  chain.  They  give  the  one  step 
n n —n 

transition  probabilities  and  find  necessary  and  sufficient  conditions  for  the 
chain  to  be  recurrent,  non-null,  aperiodic.  The  probability  generating 
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function  for  the  queue  length  process  {Yn,N  } is  then  determined.  The  busy 
period  and  output  process  is  studied  in  detail.  The  paper  presents  a few 
special  cases  of  the  results  relevant  to  computer  modelling.  Of  particular 
Interest  for  applications  is  their  study  of  the  round  robin  system,  the 
foreground-background  problem,  and  the  special  case  in  which  (Y^f  is  a 
Bernoulli  process.  This  latter  case  seems  to  be  the  only  one  fully  developed 
in  previous  feedback  literature  (e.g.,  see  Takacs  (1963)  and  the  review  of 
computer  modelling  uses  of  queues  with  feedback  in  Wyszewianski  and  Disney 
(1974]). 

Disney  and  d' Avignon  (19771  study  the  embedded  queue  length  process  for 

the  Mj/C.j/l  queue  with  the  feedback  structure  given  in  section  2.1  depending 

on  Z'.  They  show  (Y  ,N  } is  a Markov  chain.  They  determine  conditions 
n 1 n — n 3 

necessary  and  sufficient  for  the  (Y^.N^)  process  to  have  a steady  state  and 

1 2 

then  determine  the  probability  generating  functions  for  the  joint  {Y^.N^.N^l 
process.  {Y^.zV  is  studied  as  are  several  marginal  processes  obtained  from 
these.  The  busy  period  is  studied  in  detail. 

Fujisawa  and  Osawa  (1975J,  in  the  course  of  studying  departures  from 
queues  with  feedback,  consider  the  M/M/1  queue  with  {Y  ),  a two  state  Markov 
process.  They  show  that  {Y^.N^}  is  a Markov  chain,  find  the  one  step 
transition  probability  matrix,  conditions  necessary  and  sufficient  for  the 
Markov  chain  to  have  a limiting  distribution,  and  give  the  generating  function 
for  that  limiting  distribution. 

In  each  of  the  above  cases,  the  derived  generating  functions  seem  to  be 
quite  complex.  We  have  not  reproduced  the  results  in  this  paper  for  that 
reason.  The  interested  reader  will  find  details  in  the  referenced  paper. 

In  studying  these  processes  in  detail,  it  quickly  becomes  apparent  that 
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in  many  cases  one  can  consider  a queueing  system  without  feedback  whose 
asymptotic  queue  length  distribution  is  identical  to  that  for  a queue  with 
feedback.  Indeed,  these  queues  with  feedback  have  often  been  dismissed  from 
examination  precisely  for  this  reason.  d'Avignon  and  Disney  [1978]  explore 
this  question  in  more  detail.  By  studying  the  queue  length  process  at 
departure  epochs  (instead  of  output  epochs  as  is  done  herein),  one  can  obtain 
a queue  length  process  for  a queue  without  feedback  that  is  asymptotically 
identically  distributed.  The  cases  they  study  (i.e.  {Y^}  has  the  structure 
of  section  2.1  without  the  dependence  on  and  with  Poisson  arrivals)  give 
sufficient  conditions  to  ensure  this  result.  We  know  of  no  more  general 
result . 

4.2.  Departures.  In  these  queues  with  feedback  there  are  at  least  two  ways 
to  study  the  departure  process.  One  can  filter  the  output  process  or  one 
can  study  the  processes  embedded  at  departure  points.  The  former  method  is 
used  in  d'Avignon  and  Disney  [1976]  for  the  system  discussed  in  section  4.1. 

The  second  method  is  used  in  the  two  Fujisawa  et  al.  papers  ([ 1974 ; 1975] ) 
noted  in  section  4.1.  This  second  method  is  also  the  approach  used  in  d'Avignon 
and  Disney  [1978]  to  study  that  problem  (see  section  4.1). 

Disney  and  McNickle  present  a study  of  the  M/G/l  queue  with  {Y^}  as  a 
Bernoulli  process  (this  is  the  problem  studied  by  Takacs  [1963])  with 
particular  reference  to  the  output  process,  departure  process,  input  process, 
and  feedback  process.  Their  departure  results  are  relevant  here.  In  their 
system  (as  in  d'Avignon  and  Disney  [1978])  it  is  shown  that  the  departure 
process  is  a Markov  renewal  process.  The  relevant  transition  functions  are 


j 


ud 


1 


33 

given  therein.  The  departure  process  is  a Poisson  process  only  for  G-M. 

Their  results  show  that  the  output  process  from  their  queues  are  never  renewal 
processes  except  in  the  special  case  in  which  there  is  no  feedback 
(i.e.  Pr[Yn  ■ 0]  * l)and,  in  that  case,  one  obtains  a renewal  process 
(which  is  a Poisson  process)  only  if  C » H (which  is  in  agreement  with  the 
Burke  [1956;1976]  or  Disney,  et  al.  [1973]  results). 

Melamed  [1977]  presents  a study  of  Jackson  queueing  networks  (Jackson 
[1957])  and  is  able  to  show  that  if  there  is  one  node  in  the  network  with 
the  property  that  output  from  that  node  has  a non-zero  probability  of 
eventually  returning  to  that  node  (i.e.  0^  > 0 for  some  n < 0 using 
Jackson's  symbolism),  then  flow  processes  along  that  loop  are  never  Poisson 
processes.  This  result  adds  new  interest  to  the  often  used  Jackson  network 
results . 

4.3.  Waiting  Times.  Waiting  times  in  these  queues  with  feedback  seem  to 
be  a major  problem.  One  can  consider  many  such  waiting  time  problems 
depending  on  where  the  fedback  unit  re-enters  the  queue.  If  the  feedback 
returns  to  the  head  of  the  queue,  then  from  the  d 'Avignon  and  Disney  results 
[1978]  noted  in  section  4.1,  one  can  find  a waiting  time  problem  equivalent 
to  a waiting  time  problem  for  a queue  without  feedback.  However,  even  in  the 
cases  considered  there,  if  the  feedback  reappears  anywhere  else  in  the  line 
(e.g.  the  feedback  goes  to  the  end  of  the  line  as  is  a common  assumption), 
the  waiting  time  problem  is  formidable.  The  problem  is  caused  by  the  fact 
that  the  waiting  time  in  the  system  is  the  sum  of  the  waiting  times  that 
that  customer  spends  each  time  he  goes  through  the  server.  Unfortunately, 
the  waiting  times  on  each  pass  through  the  server  for  the  same  customer  are 
not  independent  of  each  other.  This  is  easily  seen  by  noting  that  the 


I 
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waiting  time  for  a customer  going  through  the  system  for  a second  time 
depends  on  the  number  of  customers  to  enter  the  system  while  he  was  waiting 
to  go  through  on  his  first  pass. 

Takacs  [l963]  is  the  only  paper  that  we  are  aware  of  that  studies  the 

waiting  time  problem  in  detail.  His  results  are  for  M/G/l  queues  with  {Y  } 

n 

a Bernoulli  process.  Wvszewianski  and  Disney  [l974]  surveys  the  computer 
literature  and  presents  results  therein  concerning  moments  of  the  waiting 
time  distribution  for  round  robin  and  foreground-background  models. 

A point  ofter  made  concerning  the  queue  length  process  for  the  M/G/l 
queue  with  {Y^l  a Bernoulli  process  is  that  it  is  equivalent  to  a queue 
without  feedback  in  the  sense  that  there  always  exists  an  M/G/l  queue  with- 
out feedback  whose  limiting  probability  distribution  (for  queue  length)  is 
equal  to  that  for  the  M/G.l  queue  with  Bernonlli  feedback.  The  question 
this  arises  as  to  whether  there  is  an  M/G/l  queue  without  feedback  whose 
limiting  sojourn  time  distribution  is  equal  to  that  of  the  M/G/l  queue  with 
Bernonlli  feedback.  The  next  lemma  is  a partial  answer  to  the  question. 

Lemma  4.1.  If  the  feedback  unit  goes  to  the  tail  of  the  line  and  if  the 
M/G/l  queue  without  feedback  and  the  M/G/l  queue  with  Bernoulli  feedback  are 
to  have  the  the  same  first  three  moments  for  their  respective  total  sojourn 
time  distributions,  then  there  is  no  M/G/l  queue  without  feedback  whose  limit- 
ing sojourn  time  distribution  is  equal  to  that  of  the  M/G/l  queue  with 
Bernoulli  feedback. 

Proof.  Let  T^  be  the  sojourn  time  in  the  queue  with  feedback  to  the  tail 
w 

iif  the  line  and  T the  corresponding  sojourn  time  for  the  queue  without 

feedback.  Let  <1  be  the  n--'  moment  about  0 of  the  service  time  (for  one 
n 

pass  through  the  server)  of  the  feedback  queue.  Let  i be  the  moment 
about  0 for  the  total  service  time  in  the  queue  without  feedback.  If  the 
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two  queues  are  to  have  the  same  first  three  moments  than  it  is  a simple 
exercise  to  show 


T2  “ a2^q  + 

13  “ a3/,q  + 6(l-q)Oja2/q2  + 6(l-q)2u^/q^ 


Then  using  the  expected  sojourn  time  and  the  second  mement  of  the  sojourn 
L ime  for  the  queue  with  feedback  given  by  Takacs  [l963]  and  the  well  known  results 
of  corresponding  moments  for  the  M/G/l  queue  without  feedback  one  obtains 


E[TW]  - E[Tf] 
e[(TW)?]j‘  E[(Tf)2] 

unless  q * l(i.e.  there  is  no  feedback)  □ 

The  following  results  structure  the  problem  as  a Markov  renewal  process 
for  the  M/M/1  queue  with  {Y^}  a Bernoulli  process,  but  even  here  computations 
using  this  structure  seem  too  tedious.  We  have  not  pursued  the  topic. 


Pick  a customer  once  and  for  all.  Call  him  C.  Suppose  he  feeds  back 
K times  in  all.  The  distribution  of  K is  geometric  in  this  case.  Let 

N - the  number  of  customers  left  behind  the  n—  time  C outputs 
• n 

(n  - 1,2,  •••) 

T - the  time  at  which  C outputs  for  the  ir—  time  (n  = 1,2,**’) 
n 

X - T - T , (the  sojourn  time  of  C on  his  n^  pass),  (n  = 2,3,‘*') 
n n n-1 


S L 

* X j *>  soujourn  time  of  C on  his  1— - pass  through  service 


B^Cy)  * number  of  exogeneous  arrivals  in  the  n — sojourn  time  of 

C,(n  = B (y)  is  a Poisson  process  (X)  for  every  n. 

B (v)  is  a Poisson  process  (X)  for  every  n. 


C = number  of  customers  ahead  of  C at  the  start  of  his  n-^  pass 
n 

through  the  server  who  feedback  - Cn  is  a bimomial  random 


variable  given 


Theorem  4.2  {N^,  X^}  is  a delayed  Markov  renewal  process. 

Proof.  This  is  quite  apparent.  Q 

Let  Hc(x)  be  the  remaining  service  time  of  the  customer  in  service 
at  the  arrival  of  C.  Let  H^(x)  be  the  i-fold  convolution  of  H with  itself. 
Then  we  have 


Corollary  4.3.  The  transition  functions  for  the  {B^mX^}  process  are  given  by: 


Dtj(x)  = Pr[N1=j,X1<x|No=i] 


H(dy)A(.(y), 


■/ <Hc*Hi 


) (dy)A1 j (y) , 


if  i = o, 


i - 1,2,- 


QIj(*)  - fr[Nn.J,XnS>.|Kn_1-l] 


'/  " 


(dy)Ati)(y),  i - o. 
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Proof.  Conditioned  on  C feeding  back  k times  corollary  4.4  gives  the  Joint 

distribution  of  N.  and  if.  conditioned  on  N . The  result  then  follows  bv 
k k o 7 

removing  the  condition  for  the  number  of  feedbacks  and  for  No  and  finding  the 

f 

resulting  marginal  distribution  for  T • □ 

Thus  the  marginal  sojourn  time  of  C are  given  by  theorem  4.5.  Notice 

that,  in  general,  successive  sojourn  times  are  not  Independent  and  therefore 
the  sojourn  time  process  is  not  specified  by  theorem  4.5  alone.  Notice  also 
that  the  Bernoulli  process  (Y^)  plays  a minor  role.  The  results  can  be  genera- 
lized at  least  to  the  case 

Pr  |Y  -u|Y  -v,  N “j  ,N  ,-i,  S =y~|. 

L n I n-1  n J n-1  — ’ n 7 J 

Thus  in  principle,  the  sojourn  time  problem  for  M/G/l  queues  with  feedback 
is  solved  for  a rather  large  class  of  {Y^} processes.  To  go  beyond  theorem 
4.5  , however,  to  find  Pr  [tG  explicitly  seems  to  be  a formidable  computation 
problem  even  for  M/M/1  queues  with  Bernoulli  feedback. 

There  is  an  interesting  question  in  these  results,  however.  We  know 
from  lemma  4.1  that  there  is  no  M/C/1  queue  without  feedback  whose  sojourn 
time  distribution  is  equal  to  the  M/C/1  queue  with  Bernoulli  feedback  if  the 
two  service  times  are  to  have  the  same  first  three  moments.  If  we  relax  this 
moment  requirement,  the  problem  can  be  exposed  as  follows. 

Let  *Q(x)  be  any  Markov  renewal  kernel  for  which  there  exists  a probability 

* _ 

vector  II  such  that 

* _ * *_ 

n q(iu)  = n. 

Then  is  there  a (V  Q)  pair  for  which 
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It'  there  Is  such  a pair,  Is  there  an  M/C/l  queue  without  feedback  for  which 
*Q(x)  is  the  Markov  renewal  kernel  for  the  sojourn  time  of  a customer?  That 
is,  is  there  any  M/G/l  queue  without  feedback  whose  sojourn  time  distribution 
for  a g i ven  customer  is  equal  to  that  sojourn  time  given  for  the  M/G/l  queue 
with  Bernoulli  feedback  In  theorem  4.1)? 
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